Application Number: 10/084,715 

Attorney Docket: US020013 

Response to Office Action of November 28, 2006 



IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

Applicants: John Zimmerman j Examiner: Clyde H. Jones III 

Serial No.: 10/084,715 j Art Unit: 2623 

Filing Date: February 25, 2002 j Confirmation No.: 6622 

For: Method and apparatus for an adaptive I Attorney Docket No.: US020013 
audio-video program recommendation system j 

Commissioner for Patents 

P.O. Box 1450 

Alexandria, VA 22313-1450 

DECLARATION UNDER 37 C.F.R. $1.131 

I, John Zimmerman, declare as follows: 

1 . I am an inventor of the above-referenced application. 

2. Prior to December 3, 2001, 1 completed and signed a Disclosure of Invention, copy 
attached as Exhibit A, which was designated docket number 702039 as represented 
thereon. 

3. The subject invention was established in the United States of America. 

4. The Disclosure of Invention sets forth the following: 

a. TV show and Movie recommenders do not start off knowing every TV show a 
user has ever watched. Because of this they often recommend content users have 
already seen. Users often don't choose to watch what they have seen before so the 
system either infers incorrectly that the person does not like the recommendation 
of this kind of content, or the system annoyingly keeps recommending it. 

b. This invention allows users to inform the system of their previous history, 
allowing for better recommendations. 

c. A simple solution is to add a button to the recommendation. Users could click this 
button to inform the system that they have already seen this program. Over time 
the system will learn many of the shows users have seen before they started using 
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this recommender allowing the system to build a better profile of the user. In 
addition, the system could pre-check the button when it recommends something it 
knows the user has already seen. 

d. The best time to ask users what they've seen is at the moment they are getting a 
recommendation. Users could be asked ahead of time what they have seen, but 
they could never remember everything. Also, asking ahead of time creates too 
much work before the system gives something back to the user. Adding 
information along the way makes for a more enjoyable user experience. 

e. This would be good for web interfaces that recommend content, music systems 
that download content, Set top boxes that show Pay-Per-View movies, or TV hard 
disk recorders that recommend broadcast or stored TV shows and movies. 

f. A sample drawing is attached to the Disclosure of Invention showing an example 
of the above. 

5. This Disclosure of Invention was submitted to outside counsel by letter dated prior to 
December 3, 2001, copy attached as Exhibit B. 

6. Subsequent thereto. I worked with outside counsel to finalize the patent application and 
was presented with the patent application and drawings attached hereto as Exhibit C for 
review. Such patent application is designated by attorney docket number 702039. 

7. Such patent application embodies the same invention as provided in my Disclosure of 
Invention as evidenced, by example, with reference to the following sections: 

a. Abstract: An audio-video program recommendation system stores a list of 
preferred programs previously selected by a user. Each time the system is 
activated, the list of previously selected programs is compared with a separate, 
externally-supplied list of currently available programs, and recommended 
programs are then displayed in accordance with an algorithm based upon the 
number and type of previous selections by the user. To avoid repetitive 
recommendations as well as recommendations erroneously based upon 
misinterpretation of the user's pattern of selections, a dedicated signal means is 
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provided to allow a user to identify, for storage, programs that the user has 
selected previously independently of the system. To enhance the system and the 
stored list or lists, if desired, an additional switch or switches may be provided to 
identify programs, for example, which the user specifically does not wish to be 
recommended. Signals derived from the dedicated switches adapt the stored 
record list or lists to reflect more accurately, the profile of the user's preferences, 
b. Claim 1 : An audio- video program recommendation system for listing program 
material in accordance with a user's preferences, said system comprising: a 
microprocessor for recognizing and processing identifying signals for program 
items; an electronic storage device coupled to said microprocessor for storing 
look-up lists of program items and signals associated therewith; a 
recommendation algorithm incorporated into said microprocessor for choosing 
and listing recommended program items based upon the nature and frequency of 
previous program item selections that are recorded in said look-up lists in said 
electronic memory device; and, a user-operable input signal device coupled to 
said microprocessor, enabling a user to selectively identify selected ones of said 
recommended program items as having been previously viewed, such that said 
microprocessor then adds said selected ones of said program items to said look-up 
lists in said memory device. 

8. The patent application describes a recommendation system that enables a user to select 
programs already viewed to avoid repetitive recommendations in the future, as described 
in the Disclosure of Invention. 

9. On December 3, 2001, after reviewing and understanding the contents of the application 
attached hereto as Exhibit C, I executed a Declaration and Power of Attorney, copy 
attached as Exhibit D, referencing the same application entitled "METHOD AND 
APPARATUS FOR AN ADAPTIVE AUDIO-VIDEO PROGRAM 
RECOMMENDATION SYSTEM (ID#702039)." Thus, the Declaration and Power of 
Attorney that I executed on December 3, 2001, pertains to the instant invention. 

-3- 



Appl ication Number: 1 0/084,7 ] 5 

Attorney Docket: US020013 

Response to Office Action of November 28, 2006 



10. By letter dated prior to January' 31, 2002 (attached Exhibit E), the application (Exhibit C) 
and executed declaration (Exhibit D) were returned to the Applicant's employer Philips 
Electronics for filing in the USPTO. 

1 1. The same application attached hereto as Exhibit C was subsequently filed in the USPTO 
on February 25, 2002. 

12. Thus, conception of the instant invention occurred prior to January 31, 2002. 

13. From the time the application was returned to Philips Electronics, until the time the 
application was filed in the USPTO on February 25. 2002. Applicant's attorney exercised 
reasonable diligence in filing the patent as per the attached Declaration of Aaron Waxier, 
the attorney that filed this application in the USPTO. 

14. 1 hereby declare that all statements made herein of my own knowledge are true and that 
all statements made on information and belief are believed to be true: and further that 
these statements were made with the knowledge that willful false statements and the like 
so made are punishable by fine or imprisonment, or both, under Section 1001 of Title 18 
of the U.S. Code and that such willful false statements may jeopardize the validity of the 
application or any patent issued thereon. 



Respectfully submitted, 
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METHOD AND APPARATUS FOR AN ADAPTIVE AUDIO- VIDEO PROGRAM 
RECOMMENDATION SYSTEM 

1. Field of The Invention 

5 This invention relates generally to "recommendation lists" for identifying specific 

electronic audio-video program materials or other "listed items" that may be of particular 
interest to a given user, based upon the user's preferences. 

2. Description of the Related Art 

10 Individual audio-video programs are readily identifiable and distinguishable from 

one another by characteristic recorded signals that form part of each program item. 
Systems are currently available for "recommending" such program items to a particular 
user in accordance with stored recorded data that identify types of program materials 
preferred by that user. A serious disadvantage of the known systems of this type, is that 

15 they rely on storing patterns of previously made selections, chosen by the user from 
available program materials. Previously made selections serve a dual purpose in that in a 
first place, they establish a pattern showing the kind of program material that the user 
prefers, and in a second place, they allow the elimination from current displays of programs 
previously chosen for use by the user. However, this form of system operation is a 

20 disadvantage because such systems will continuously display programs listings that the user 
will not ever choose, either because those materials have been viewed previously and will 
not be viewed again, or because the user otherwise knows the material content and does not 
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find it acceptable for use. Further, a user's failure to choose numerous programs of a given 
type that the viewer has seen previously outside of the system, may lead the system to 
"infer", erroneously, that the user does not prefer those programs and will then stop listing 
that type of program, entirely, contrary to the user's preference for them. From another 
5 standpoint, the "visual clutter" caused by continued listing of programs that the user does 
not wish to use, is both unacceptable and counter-productive to the intended purpose of the 
"recommendation" system. 



SUMMARY OF THE INVENTION 

10 

The program recommendation system of the present invention avoids the visual 
clutter, the listing of undesired materials, and the unintended exclusion of otherwise 
preferred programs that characterize existing recommendation systems. The system of this 
invention allows users to identify specific programs that the user does and/or does not wish 

15 to see listed again. In a preferred form of the invention, the controlling microprocessor of 
the system is provided with at least one "dedicated" input signaling device, such as a 
designated push button for example, that creates a unique "add this to the list of previously 
selected programs" signal to identify a particular program item in all future listings. The 
system of the invention may be further enhanced, if desired, by providing a similar 

20 dedicated push button that associates a unique, " listing preference" signal with specific 
program items, to be referred to by the microprocessor in the preparation of future 
recommendation listings. 
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In the disclosed embodiment of the invention, a conventional television receiver is 
coupled to a microprocessor programmed to recognize the conventional signals that 
identify individual programs. An electronic memory device of any suitable type is 
associated with the microprocessor and coupled to record signals identifying selected 

5 programs, so as to create a stored/recorded list of programs that have been selected for 
viewing. A selectively operable input signal device coupled to the microprocessor permits 
a user to add a program to the list of previously selected programs [the "previously 
selected" list] without actually selecting the program for viewing. Preferably, the memory 
device includes the capacity to maintain separate lists of programs previously selected by 

10 different viewers, with each viewer being uniquely identified by separate viewer- 
identification signals. 

When the system is used, a potential viewer enters a signal to access the desired 
viewer's associated preference list, and then selectively accesses the list of programs 
currently available. The microprocessor of the recommendation system then compares the 

15 preference list with the "currently available" list and processes the two lists according to an 
algorithm that chooses programs to list as "recommended", while excluding all programs 
that are included in the "previously selected" list. In accordance with existing technology, 
programs are chosen for recommendation based at least in part on the number of times that 
similarly categorized programs have been selected for viewing by a particular viewer in the 

20 past. 

By allowing the viewer to add programs, selectively, to the list of previously 
selected programs, this invention provides users with the advantage of being able to avoid 
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having to deal with repetitive "recommendations" of programs that the viewer has seen 
previously. Prior art recommendation programs characteristically list all programs of the 
type "preferred" by a specific viewer, if such programs were not previously selected for 
viewing through the recommendation system, Following comparison of the lists, the 
5 microprocessor of this system forwards the list of "recommended" programs to the video 
receiver for display, 

It is at least feature of the recommendation system of this invention, that a user may 
modify the list of previously viewed programs by adding to it, selectively, programs that 
were not previously selected through the system. 
10 These and other features and advantages of this invention will be made more 

apparent to those having skill in this art, by reference to the following detailed description 
of the preferred embodiment considered in conjunction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

15 

FIG. 1 is a simplified, overall block diagram of the recommendation system of this 
invention; 

FIG. 2 is a flow chart illustrating the sequential steps in the operation of the 
disclosed system of this invention; and, 
20 FIG. 3 represents an illustrative "menu" of the type that the system of this invention 

presents to a user. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

In the following description, certain specific details of the disclosed embodiment 
such as architecture, interfaces and techniques, etc, are set forth for purposes of explanation 

5 rather than limitation, so as to provide a clear and thorough understanding of the present 
invention. However, it should be understood readily by those skilled in this art, that the 
present invention may be practiced in other embodiments which do not conform exactly to 
the details set forth herein, without departing significantly from the spirit and scope of this 
disclosure. Further, in this context, and for the proposes of brevity and clarity, detailed 

10 descriptions of well-known apparatus, circuits and methodology have been omitted so as to 
avoid unnecessary detail and possible confusion. 

Referring now to Figure 1 of the accompanying drawings, the disclosed program 
recommendation system 10 in accordance with this invention may be seen to comprise a 
microprocessor 12 coupled to receive program listings from a program source 14 and to 

15 display programs as well as processed results on a conventional TV receiver 16. The 
microprocessor is further coupled to exchange information with an electronic memory 
device 1 8 and to receive viewer preference signals from a selectively operable input signal 
device 20. In this regard, it should be noted that microprocessor 12 and memory device 18 
may be embodied in the form of a conventional computer apparatus, and selectively 

20 operable signal device 20 accordingly may be, for example, merely a conventional 
computer keyboard with one or more "dedicated" keys or "push buttons" assigned to 
perform the tasks herein disclosed. 
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In use, receiver 16 is coupled to program source 14 to receive program signals 
through microprocessor apparatus 12, in a substantially conventional manner. A user 
wishing to obtain a recommendation of program materials in accordance with this invention 
would tune receiver 16 to a reception channel showing listings of available program 

5 materials. Such "program guide channels" are well-known and widely available from many 
sources; they are known to include category and content signals that characterize various 
types of programs for use by viewers seeking assistance in choosing programs for viewing. 

When microprocessor 12 is activated, it delivers electronic "recommender menu" 
signals to receiver 16 to facilitate utilization of the recommender system by a user. 

10 Electronic menu signals of either passive or interactive type are well-known in the art at 
this time, and the apparatus and methods for their generation will not be explained in 
further detail here. In this regard, the term, "passive", refers to menus which merely 
instruct the user to take a certain action, but the menu plays no other part in effectuating the 
suggested action or instruction; on the other hand, the term, "interactive", is used here in 

15 reference to menus of the touch-screen type, in which the user "interacts" with the menu by 
touching part of the display screen and the menu in turn "interacts" with the user's touch by 
effectuating the instruction or advice corresponding to the location that has been touched. 

For the purposes of this invention, the menu displays on the screen of receiver 16, 
instructions for the user to follow so as to initiate action of the recommendation system. 

20 Accordingly, one instruction would request identification of the user, for example by 
pressing one of a predetermined number of "user buttons" on the selectively operable input 
signal device 20. Microprocessor 12 responds to the user identification signal received 
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from signal device 20 by accessing a "user preference profile" stored in electronic memory 
device 18. The creation, storage and accessing of such profiles are likewise well-known at 
this time and, accordingly, will not be explained further for the purposes of this disclosure. 
After the applicable user profile for the identified user has been accessed, it is 

5 compared by the microprocessor 12 with the list of available programs obtained from 
program source 14, and a resulting list of "recommended" programs is then delivered to the 
display screen (not shown) of receiver 16 in accordance with any suitable well-known 
technique. Microprocessor 12 accompanies the display of recommended programs with a 
suitable added "menu" that allows the user the option of marking or otherwise identifying a 

10 "selected" program item on the recommended list. 

In addition to the selection option, the user is presented with at least two additional 
options concerning the selected program item: one option allows the user to proceed with 
viewing of the selected item (i.e. the "View" option). In accordance with this invention, a 
second option of significant importance allows the user to mark the selected item with an 

15 identifying signal indicating that the viewer has seen the selected program item previously 
and does not wish to have it "recommended" again. Both of these options are activated in 
the disclosed embodiment by "dedicated" push buttons associated with selectively operable 
input signal device 20. However, it will be understood readily by those skilled in this art, 
that activation techniques other than dedicated push buttons may be used within the scope 

20 and spirit of this disclosure. For example, as explained briefly in a preceding paragraph in 
this specification, interactive touch-screen menus may be used, in which an option is 
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effectuated when the user merely touches an appropriate, indicated location on the video 
screen of receiver 16. 

To more clearly disclose and point out the operation of the system of this invention, 
Figure 2 of the drawings presents a flow chart of system steps that follow activation of both 

5 microprocessor 12 and receiver 16 of Figure I. Accordingly, Figure 2 shows that the first 
step 100 in the operation of the system is the accessing of a list of available program 
materials, obtained from program source 14 such as, for example, commercial cable or 
broadcast signals. This "step" is achieved by a user manually selecting a corresponding 
broadcast or cable channel, using the channel-tuning capability of receiver 16 of Figure 1. 

10 In step 102, subsequent to step 100, in response to a viewer request to activate the 

recommender system, microprocessor 12 accesses the appropriate user profile stored in 
memory device 18 and then proceeds with a comparison, step 104; comparing the user 
"profile" with the "available" list to produce a short, "recommended" list of recommended 
program items. In effect, step 104 applies a recommendation algorithm to select from the 

15 list of available program items a predetermined number of recommended items, say 3 or 5 
or 10 or any other reasonable number, based upon identification of the category and 
frequency of related selections previously made or viewed by the user. 

In step 106, microprocessor 12 directs the "recommended" list to display on the 
screen of receiver 16 together with an action "menu", for inspection and further action by 

20 the user. In accordance with this invention the viewer then has to choose among various 
menu options so that the system can continue its operations. That is, the viewer first has 
the option of "selecting" one of the program items that appears on the "recommended" list. 
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As in many video display systems, a listed item is "selected" by moving a cursor or marker 
onto the listed item on the screen and then activating an "enter" or "selection" button. In 
the system here disclosed, such an activation button is provided conveniently on any 
convenient surface of the selectively operable input signal device 20. After an item has 

5 been selected in this or any readily equivalent manner, the user of the system of this 
invention next has the options, as explained in further detail below, of either electing to 
"view" the selected item or, identifying the selected item as having been "previously seen". 
In this context, "previously seen" means generally that the user has previously viewed the 
selected program item outside the purview of this system. 

10 In step 108, microprocessor 12 checks for receipt of the "selection" and ''previously 

seen" or "view" signals from selectively operable electronic input signal device 20. If 
"view" is detected together with the "select" signal, step 110, microprocessor 12 then 
couples receiver 16 to display the selected program and disengages from further 
"recommendation" action until it is called upon to initiate a further recommendation 

15 sequence. In the alternative, if "previously seen" is detected together with the selection 
"signal", step 1 12, microprocessor 12 acts to (a) revise the display on receiver 12 to show a 
revised list of recommended program items, and (b) revise the viewer profile stored in 
memory device 18 so as to associate the "previously seen" signal with the "selected 
program" for all future comparison actions. Accordingly, that specific program item will 

20 be treated in the future in substantially the same manner as though the user had selected the 
program for viewing. In fact, it should be recognized that the principal distinction between 
the "select" signal and the "previously seen" signal for the purpose of this invention is that 
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the system must not select the previously seen program for viewing in response to the 
"previously seen" signal generated by selectively operable electronic input signal device 20. 

To further point out and clarify operation of the system of this invention, Figure 3 
illustrates an embodiment of a typical "screen menu" 200 that would be displayed for a user 

5 of the system after completion of steps 100 through 106. In brief, microprocessor 12 
causes the "menu" items to appear on the screen of receiver 12 in association with the 
program items that the microprocessor has chosen to "recommend." Accordingly, a 
predetermined number (three are shown for purposes of illustration only), of program 
recommendations 202 appear on the screen together with an illustrative/explanatory caption 

10 204, such as "Recommended Programs Available at (next available start time or another 
selected time within the range of the commercially supplied list of all 'available' programs) 
Today", the whole being accompanied by instructional material 206 presenting the specific 
options described previously herein, for example: [1] "Highlight any previously viewed 
program(s) and press PV to avoid repeat listing of this program"; and [2] Highlight any 

15 program selected for viewing and press V to view". 

Although a most significant menu option provided by the recommendation system 
of this invention has been disclosed and described, those having skill in this art will 
recognize that a wide variety of additional "options" may be provided on the same or 
separate viewing screens, if desired. For example, under some circumstances, it would be 

20 desirable to include and list as an option: Highlight unacceptable program and press U to 
help identify and avoid listing of similar category programs in the future. It should be 
understood that such an option could speed up and generally enhance the process of 
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building a profile of the user's preferences. In this application, the term "recommendation 
lists" is intended to include movies, music, books, and other items in which a recommender 
system can learn by observing the user's selection over time to generate a user profile. For 
example, a user profile on a particular user's reading and purchasing habits over the Internet 
5 may be used as criteria to void undesirable in all future listings. 

Although a preferred embodiment of the invention has been illustrated and 
described, it will be obvious to those having skill in this art that various other forms and 
embodiments now may be visualized readily without departing significantly from the spirit 
and scope of the invention disclosed herein and set forth in the accompanying claims. 
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What is claimed is: 

1. An audio-video program recommendation system for listing program 
material in accordance with a user's preferences, said system comprising: 

5 a microprocessor for recognizing and processing identifying signals for program 

items; 

an electronic storage device coupled to said microprocessor for storing look-up lists 
of program items and signals associated therewith; 

a recommendation algorithm incorporated into said microprocessor for choosing 
10 and listing recommended program items based upon the nature and frequency of previous 
program item selections that are recorded in said look-up lists in said electronic memory 
device; and, 

a user-operable input signal device coupled to said microprocessor, enabling a user 
to selectively identify selected ones of said recommended program items as having been 
15 previously viewed, such that said microprocessor then adds said selected ones of said 
program items to said look-up lists in said memory device. 

2. An audio-video program recommendation system in accordance with Claim 
1 , wherein said user operable input device is a dedicated push-button. 

20 
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3. An audio-video program recommendation system in accordance with Claim 
1, wherein said user operable input device comprises a plurality of dedicated push buttons, 
at least one of said plurality of push buttons serving to selectively identify said selected 
ones of said recommended program items as having been previously viewed, and at least 

5 another one of said push buttons serving to identify a selected one of said recommended 
program items for current viewing. 

4. An audio-video program recommendation system in accordance with Claim 
3, wherein said recommendation algorithm further serves to recognize program items that 

10 are identified as unacceptable; said microprocessor is programmed to create a look-up list 
of unacceptable programs for storage in said memory device; and, at least another one of 
said plurality of dedicated push buttons serves to identify unacceptable programs for 
storage in said memory device. 

15 5. An audio-video program recommendation system for listing program 

material in accordance with a user's preferences, said system comprising: 

a computer apparatus capable of recognizing, processing and storing look-up lists of 
identifying signals for program items; 

a recommendation algorithm incorporated into said computer apparatus for 
20 choosing and listing recommended program items based upon the nature and frequency of 
previous program item selections that are recorded in said look-up lists; and, 
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said computer apparatus further comprises a keyboard having at least one key 
capable of identifying selected ones of said recommended program items as having been 
previously viewed, such that said computer apparatus then adds said selected ones of said 
program items to said look-up lists. 

5 

6. An audio- video program recommendation system in accordance with Claim 
5, wherein said user operable input device is a dedicated push-button on a computer 
keyboard. 

10 7. An improved method of recommending program listings in accordance with 

a user's selection preferences, said method comprising the steps of: 

accessing a first electronic list representing programs available for viewing at a 
given time; 

accessing a second electronic list representing a compilation of programs previously 
15 selected for viewing by an identified user of the system; 

comparing said first electronic list with said second electronic list, to obtain a list of 
recommended program items based upon the nature of the previously selected programs 
identified in said second electronic list; 

displaying said list of recommended program items on a video display device for 
20 inspection by said user; 
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selectively identifying and characterizing by a corresponding electronic signal, a 
program item on said list of recommended program items that was previously viewed by 
said user; 

appending to aid second electronic list, program items included in said list of 
5 recommended program items that are currently selectively identified and characterized by 
said identified user; and, 

displaying said first electronic list on a video display device, while excluding from 
said display all programs on said second list. 

10 8. An proved method of recommending program listings in accordance with 

Claim 7, further comprising the step of checking for the receipt of a signal indicating the 
user's desire to view a program and presenting such identified program item for viewing. 

9. An improved method of recommending program listings in accordance with 
15 Claim 7, further comprising he step of displaying a screen menu, together with said 

displaying of recommended program items, indicating the actions to be taken by a user 
employing said method. 

10. An improved method of recommending program listings in accordance with 
20 Claim 9, further comprising the step of displaying together with said screen menu, an 

illustrative caption identifying said method of recommending program listings. 
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ABSTRACT OF THE DISCLOSURE 

An audio-video program recommendation system stores a list of preferred programs 
previously selected by a user. Each time the system is activated, the list of previously 

5 selected programs is compared with a separate, externally-supplied list of currently 
available programs, and recommended programs are then displayed in accordance with an 
algorithm based upon the number and type of previous selections by the user. To avoid 
repetitive recommendations as well as recommendations erroneously based upon 
misinterpretation of the user's pattern of selections, a dedicated signal means is provided to 

10 allow a user to identify, for storage, programs that the user has selected previously 
independently of the system. To enhance the system and the stored list or lists, if desired, 
an additional switch or switches may be provided to identify programs, for example, which 
the user specifically does not wish to be recommended. Signals derived from the dedicated 
switches adapt the stored record list or lists to reflect more accurately, the profile of the 

15 user's preferences. 
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